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DEVELOPMENT  OF  AN  ALTERNATE  FORM 
OF  rpETF. 

NAVY  OFFICER  CLASSIFICATION  BATTERY 
Abstract 

Following  specifications  laid  down  by  the  Classification  and  Survey 
Research  Branch,  Personnel  Analysis  (formerly  Research)  Division,  Bureau 
of  Navel  Personnel,  staff  members  of  the  Educational  Testing  Service  have 
developed  an  alternate  form  of  the  Navy  Officer  Classification  Battery, 
and  an  additional  form  of  the  Mechanical  Comprehension  Test  of  this 
battery. 

Ttest  questions  were  tiled  out  at  the  U.  S.  Naval  School,  Officer 
Candidate,  at  Newport.  Item  difficulty  and  item  discrimination  indices 
were  then  derived,  and  constituted  an  important  element  in  the  process  of 
selecting  items  for  use  in  the  alternate  forms  of  the  teBtB. 

After  the  tests  had  been  printed  by  the  government,  the  standard- 
ization of  the  tests  was  carried  out  by  ETS  with  the  fur Lher  cooperation 
of  the  Officer  Candidate  School.  As  a final  step  in  the  project,  con- 
version tables  were  prepared  linking  raw  scores  on  each  test  to  raw 
scores  on  the  previous  test  form  and  to  the  Navy  Standard  Score  scale. 

Correlational  and  other  statistical  data  obtained  during  the  stand- 
ardization indicated  that  a satisfactory  alternate  form  of  the  battery 
and  a satisfactory  additional  form  of  the  Mechanical  Comprehension  Test 
had  been  prepared. 
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development  of  an  alternate  form 

OF  THE 

NAVY  OFFICER  CLASSIFICATION  BATTERY 


Introduc  tion 


In  the  chapter  on  "Basic  Tests  for  Officer  Personnel"  in  Personnel 
Research  and  Test  Development  in  the  Bureau  of  Naval  Personnel,  there  is 
reported  the  background  for  the  development  of  the  Officer  Classification 
Battery  currently  in  use  by  the  Navy.  The  predecessor  of  this  battery 
was  the  Officer  Classification  Test.  A revision  of  the  latter-named 
test,  including  the  introduction  of  a Relative  Movement  section,  was 
named  the  Officer  Classification  Battery.  Hence  the  "first"  form  of  the 
Battery  was  labelled  Form  2. 

The  Battery  consists  of  five  tests,  as  follows: 


I 

Verbal  Reasoning 

75 

five-choice 

items 

II 

Mechanical  Comprehension 

43 

five-choice 

items 

III 

Mathematics 

50 

five-choice 

items 

IV 

Relative  Movement 

50 

four-choice 

items 

V 

Spatial 

A.  Block  Assembly 

30 

four-choice 

items 

B.  Block  Recognition 

30 

five-choice 

items 

Late  in  1951  the  Classification  and  Survey  Research  Branch,  Research 
Division,  Bureau  of  Naval  Personnel,  and  the  Personnel  and  Training 
Branch,  Psychological  Sciences  Division,  Office  of  Naval  Research, 
jointly  agreed  to  support  a research  and  development  project  to  be 
carried  out  by  Educational  Testing  Service.  One  of  the  major  tasks  to 
be  accomplished  under  this  contract  was  the  development  of  an  alternate 
form  of  the  Officer  Classification  Battery. 

Test  Specifications 

Specifications  for  the  new  set  of  tests  were  essentially  given  by 
the  statement  that  an  alternate  form  of  each  test  was  desired.  To  per- 
mit use  of  either  Form  2 or  the  new  Form  3 without  major  change  in  ad- 
ministrative procedures,  it  was  specified  to  ETS  that  each  of  the  various 
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tests  in  the  new  form  of  the  battery  should  contain  the  same  number  of 
items  as  had  that  in  Form  2,  and  that  no  drastic  changes  in  directions 
or  time  limits  should  be  contemplated. 

After  a thorough  review  of  the  existing  test  forms  by  members  of 
the  ETS  Test  Development  staff , recommendations  were  made  to  the  Classi- 
fication and  Survey  Research  Branch  which  led  to  the  following  additional 
specifications : 

1.  Verbal  Reasoning  Test 

a.  While  not  to  be  strictly  and  solely  of  the  science 
analogy  type,  items  were  to  avoid  words  that  were 
especially  literary  or  artistic  in  flavor. 

b.  The  test  directions  were  to  be  edited  to  improve 
clarity  through  minor  changes  in  wording. 

c.  The  format  of  the  items  was  to  be  modified  to  secure 
greater  clarity. 

2.  Mechanical  Comprehension  Test 

Whenever  possible,  all  choices  provided  for  a test  item  were 
to  be  presented  in  a single  line. 

5.  Mathematics  Test 

Items  were  to  be  constructed  which  would  emphasize  alti- 
tude rather  than  achievement  in  mathematics,  for  persons  who 
had  completed  undergraduate  work  in  college. 

4.  Relative  Movement  Test 

a.  Items  in  the  existing  test  were  to  be  paralleled  in  the 
the  new  form  by  corresponding  items  requiring  similar 
mental  operations. 

b.  Directions  were  to  be  edited  to  improve  clarity.  Defini- 
tions of  certain  terms,  e.g.,  knot,  were  to  be  added. 

5-  Spatial  Relations  Test 

It  was  specified  that  items  in  Form  5 of  this  test  were  to 
be  of  a somewhat  greater  average  difficulty  than  those  for 
Form  2.  For  best  measurement,  it  seemed  especially  desirable 
to  step  up  the  difficulty  of  the  Block  Assembly  section. 
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Development  of  the  Alternate  Form 

Pretests . In  order  that  a sufficient  number  of  items  of  appropriate  dif- 
ficulty and  discriminative  power  might  become  available,  it  was  decided 
to  develop  and  try  out  twice  as  many  new  items  as  would  be  required  in 
the  alternate  form.  * 

Items  were  prepared  by  members  of  the  staffs  of  various  sections  of 
the  ETS  Test  Development  Department.  In  the  case  of  Mechanical  Compre- 
hension items,  the  assistance  of  other  professional  help  was  enlisted, 
as  noted  in  the  Acknowledgments.  Two  sets  of  five  booklets,  coded  A0CX1 
and  A0CX2  respectively,  were  then  produced  containing  items  deemed 
acceptable  for  try-out.  Each  booklet  in  each  case  contained  the  same 
number  of  items  as  had  the  corresponding  test  in  Form  2 of  the  Officer 
Classification  Battery.  This  latter  fact  permitted  the  try-out  adminis- 
trations to  be  carried  out  using  the  special  IBM  answer  sheets  which  are 
employed  with  Form  2. 

The  AOCXL  pretests  were  administered  to  682  men  in  Class  6 at  the 
U.  S.  Naval  School,  Officer  Candidate,  Newport,  Rhode  Island,  on  July 
21-22,  1952.  3even  hundred  and  thirteen  members  of  Class  7 at  this 
school  were  given  the  A0CX2  pretests  on  August  22-23,  1952. 

The  time  limits  for  several  of  these  pretests  were  made  somewhat 
longer  than  those  used  with  the  actual  operational  forms  in  order  to 
ensure  that  most  of  the  pretest  group  would  have  sufficient  time  to 
attempt  every  item  in  the  test.  When  severe  drop-out  occurs  in  a try- 
out administration,  item-analysis  data  for  late-occurring  items  may 
be  of  dubious  value  or  even  misleading.  The  longer  time  limits  were 
expected  to  guarantee  freedom  from  any  high  degree  of  drop-out,  and 
this  expectation  was  in  fact  borne  out. 

The  numbers  of  items  contained  in  each  of  the  pretests  and  the 
amounts  of  working  time  (exclusive  of  directions)  for  each  are  shown 


in  Table  1. 


Table  1 


Numbers  of  Items  in  and  Time  Limits  of 
Officer  Classification  Battery  Pretests 


Pretest 

No.  of 
Items 

Time  Limit 
Minutes 

1. 

Verbal  Reasoning 

75 

35 

2. 

Mechanical  Comprehension 

48 

4o 

3- 

Mathematics 

50 

75 

4. 

Relative  Movement 

50 

50 

5- 

Spatial  Relations : 

Block  Assembly 

30 

18 

Block  Recognition 

30 

22 

Item  Analyses.  In  order  that  items  might  be  selected  for  each  new 
test  whicn  would  measure  the  same  ability  or  composite  of  abilities 
as  was  assessed  by  the  existing  test  form,  it  was  decided  to  use  as  one 
of  the  principal  means  of  selecting  items  the  correlation  between  per- 
formance on  an  item  and  the  score  on  the  corresponding  Form  2 test. 
Answer  sheets  for  Form  2 were  supplied  by  the  Officer  Candidate  School 
for  men  who  had  taken  the  pretests.  After  these  had  been  arranged  in 
alphabetical  sequence,  a spaced  sample  of  570  answer  sheets  w do  dx  awn  • 

A modification  of  the  upper-lower  group  item-analysis  procedure 
developed  by  Flanagan  was  employed.  For  each  pretest,  the  responses 
on  the  answer  sheets  of  the  100  men  with  highest  and  the  100  men  with 
lowest  scores  on  the  corresponding  Form  2 test  were  punched  into  IBM 
cards.  The  IBM  tabulator  was  then  used  to  print  onto  special  item- 
analysis  forms  the  number  of  persons  in  each  of  these  groups  marking 
each  response  to  each  item,  the  number  omitting,  and  the  number  reach- 
ing and  attempting  the  item. 

From  the  proportions  marking  the  correct  response  in  the  high  and 
low  groups,  Pjj  and  P^,  there  were  then  obtained  an  item  discrimination 
index,  r,  and  an  index  of  item  difficulty,  A.  The  discrimination  index 
is  the  correlation  which  corresponds  to  the  obtained  values  of  P_  and 

xi 

PT  in  a normal  bivariate  distribution  in  which  the  criterion  score 

-L» 

(the  basis  of  selection  of  the  upper-  and  lower-27-per-cent  groups) 
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is  plotted  against  the  continuous  variable  assumed  to  underlie  responses 
to  the  item. 

Delta  (A)  is  an  index  of  item  difficulty  developed  originally  by 
C.  R.  Brolyer  for  use  in  the  test  development  work  of  the  College 
Entrance  Examination  Board.  As  employed  in  the  current  project,  delta 
is  defined  as  follows : 

Aj  = 13  + 4 x± 

where 

A^  = the  delta  index  of  item  difficulty,  and 

x^  *=  the  abscissal  distance  in  sigma  units  from  the  mean 

to  the  point  whose  ordinate  cuts  off  an  area  under  the 
unit  normal  curve  corresponding  to  the  proportion  of 
those  attempting  the  item  who  mark  the  correct 
response . 

In  this  equation,  the  sign  of  x.^  is  taken  to  be  positive  when  p < .50, 
and  negative  when  p > .50.  The  numbers  13  and  4 were  chosen  so  as  to 
yield  an  item-difficulty  scale  the  values  along  which  are  positive 
numbers.  The  mean  of  the  scale  values  is,  of  course,  1J,  and  the 
standard  deviation  is  4.  (See  C.  T.  Fan's  Item- Analysis  Table,  Educa- 
tional Testing  Service,  1952,  for  further  description  of  this  item- 
analysis  technique.) 

Since  the  item-analysis  data  for  the  first  try-out  form  (AOCXl) 
were  based  upon  a group  different  from  that  used  for  the  second  try- 
out form  (A0CX2),  th  ere  arose  a need  for  considering  whether  diffi- 
culty values  for  one  group  would  be  comparable  with  these  for  the 
second  group.  Any  differences  in  level  and  variability  of  talent  from 
one  group  to  the  other  would  naturally  be  reflected  in  the  item-analysis 
data. 

Availability  of  the  five  Form  2 C.C.B.  scores  for  each  group  made 
possible  a comparison  of  the  test  performances  of  the  item-analysis 
groups . The  Officer  Candidate  School  made  available  to  ETS  the  average 
score  on  each  of  the  five  tests  in  the  battery  for  all  candidates 
tested  over  a year's  time.  From  study  of  these  data,  which  are  sum- 
marized in  Table  2,  it  became  clear  that  the  group  tested  with  Form 


r ■ r,;-wv  JX  »•  . - *i  f;5*« 


r 


i 


$ 

is 

i 

S' 


£ : 
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A0CX2  had  been  somewhat  superior  to  that  tested  with  AOCX1,  and  that 
the  A0CX2  group  more  closely  resembled  in  mean  score,  test  by  test,  the 
total  group  entering  OCS  in  the  year  period. 

Table  2 

Means  and  Standard  Deviations  of 
Raw  O.C.B.  Test  Scores  for  Two  Try-out  Groups, 


and  Means  for 

Entire- 

■Year  OCS 

Group 

Test 

A0CX1 

Group 

A0CX2 

Group 

Year 

Group 

M 

a 

M 

a 

M 

1,  Verbal  Reasoning 

50.1 

10.7 

51.4 

10.7 

53 

2.  Mechanical  Comprehension 

29.O 

6.8 

29.4 

6.9 

29 

5.  Mathematics 

27.0 

6.1 

29.3 

7.2 

29 

4,  Relative  Movement 

22.4 

5.3 

24.4 

5-5 

24 

5.  Spatial  Relations 
Elock  Assembly 
Block  Recognition 

21.2 

18.4 

3.6 

5.2 

21.4 

19.2 

3.6 

5.1 

J:I  (total) 

! 


It  was  therefore  decided  to  adjust  the  A0CX1  item-difficulty  indices 
so  as  to  make  these  comparable  with  those  for  A0CX2.  The  process  for 
carrying  out  this  operation  will  be  illustrated  using  the  data  for  the 
Verbal  Reasoning  try-cut  tests  as  an  example. 

First,  there  are  computed  the  parameters  a1  and  b'  required  for 
transforming  the  AGCX2  scores  so  that  the  converted  scores  have  a mean 
and  standard  deviation  of  15  and  4 respectively: 


A0CX2  Verbal  mean 


a ' 


4.0000 

10.6506 


.5756 


1 

i 

I 


b 


15  - a’  (51.5946)  » -6.5058 
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The  A0CX1  mean  and  standard  deviation  are  next  converted  by  use  of 
the  parameters  a'  and  b'.  Ihe  resulting  values  are  estimates  of  the 
mean  and  standard  deviation  of  the  adjusted  difficulty  indices  (deltas): 

Ma,  « a'  (Mean  A0CX1  Verbal)  - b' 

= a'  (50.1081)  - b’ 

“ (-3756)  (50.1081)  - 6.3058 
» 12.5168 

oA,  » a’  (a  A0CX2  Verbal) 

= a’  (10.7212) 

= (.3756) (10. 7212) 

■=  k.  0269 

The  values  of  and  o^,  are  estimates  of  what  the  mean  and  standard 
deviation  of  the  A00X1  verbal  Reasoning  difficulty  indices  would  have 
been  if  the  A0CX1  try-out  group  had  paralleled  the  A0CX2  group  in  Form 
2 Verbal  Reasoning  scores. 

There  is  still  needed  a technique  for  adjusting  the  difficulty 
index  for  a single  item.  This  requires  the  obtaining  of  values  for 
parameters  a and  b in  the  equation 

A.  1 = a A.  + b , 

1 1 ’ 

in  which 

A^  •-  the  difficulty  value  of  a given  item  as 

observed  for  the  A0CX1  try-out  group,  and 

A^  1 « the  adjusted  item  difficulty:  the  item 

difficulty  estimated  for  a group  eaual  in 
Verbal  Reasoning  ability  to  the  A0CX2 
group . 


I 


I 


«? 
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The  values  of  the  parameters  are  computed  as  follows : 


a 


I 


T 


4.0269 

4.0000 


1.01 


b a ma>  ■ 13  a 
- 12.5168  - (1.01)  (13) 


« - 0.61 

The  conversion  equation  thus  is 

A ' - 1.01  A - 0.6l 

In  Tables  A-l  through  A- 7 of  the  Appendix  there  is  presented  de- 
tailed information  on  the  item-analysis  characteristics  of  all  the  items 
pretested.  In  these  tables,  the  reported  difficulty  indices  for  A0CX1 
items  have  been  adjusted  by  the  procedure  described  above. 

In  the  cases  of  the  Verbal  Reasoning  and  Relative  Movement  pre- 
tests, further  item  analyses  were  carried  out,  this  time  against  the 
criterion  of  score  on  the  particular  pretest  itself.  Staff  personnel 
responsible  for  development  of  these  two  tests  believed  this  additional- 
information  would  be  helpful  in  the  selection  of  items  for  the  opera- 
tional form. 


Selection  of  Items.  Items  for  inclusion  in  the  new  Form  3 were  selected, 
largely  on  the  basis  of  item- analysis  characteristics,  so  as  best  to 
meet  the  specifications  laid  down  for  the  alternate  form.  Naturally, 
the  professional  judgment  of  the  test  constructor  with  regard  to  the 
items  also  played  an  important  role.  This  was  especially  true  whenever 
more  items  having  given  combinations  of  characteristics  were  available 
than  were  required  for  Form  3 • 


St 


.1 


i 
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Table  3 

Parameters  of  Equations*  for  Mjusting 
A0CX1  Difficulty  Indices  (Deltas)  to  A0CX2  Scale 


Ttest 

a 

t) 

1.  Verbal  Reasoning 

1.01 

-0.61 

2.  Mechanical  Comprehension 

0.98 

-0.02 

3-  Mathematics 

0.84 

0.8l 

4.  Relative  Movement 

0.95 

-0.78 

5.  Spatial  Relations 
Block  Assembly 

1.02 

-0.47 

Block  Recognition 

1.  .02 

-0.84 

* 

Each  equation  is  of  the  form 
Ai  = a Ai  + * 

in  which  A^  = observed  A0CX1  difficulty  index 
A£  «=  adjusted  difficulty  index 
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In  Tables  A-l  through  A-7  of  the  Appendix  there  are  indicated  the 
characteristics  of  the  items  selected  for  use,  as  contrasted  with  those 
for  items  not  chosen  for  inclusion.  Summary  data  on  selected  items,  in 
the  form  of  median  item-analysis  indices,  are  presented  in  Table  4. 


Table  4 

Median  Item-Difficulty  Indices  and 
Median  Item-Discrimination  Indices  of 
Items  Selected  for  Form  3 

Median  Median 


A 

r 

Test 

vs.  score 

vs.  score 

on  Form  2 

on  pre- 

test 

test 

1.  Verbal  Reasoning 

11-3 

.34 

.42 

2.  Mechanical  Comprehension 

12.1 

.41 

-- 

3.  Mathematics 

10.7 

.42 

-- 

4.  Relative  Movement 

10.4 

•23 

.44 

5.  Spatial  Relations 

10.8 

.44 

-- 

Preparation  of  Test  Copy  and  Reproduction.  The  selected  items  were  ar- 
ranged in  order  of  difficulty.  Photo-offset  copy  was  then  prepared  and 
forwarded  to  the  Bureau  of  Naval  Personnel.  Actual  reproduction  of  the 
tests  was  carried  out  by  the  government. 

Standardization 


The  standardization  of  the  new  Form  3 was  carried  out  using  as  sub- 
jects IO67  members  of  Class  11  at  the  Officer  Candidate  School.  Approxi- 
mately half  of  the  men  were  tested  first  with  one  form,  then  the  second, 
and  the  other  half  tested  with  the  forms  reversed  in  order,  as  follows: 
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Teat 

1.  Verbal  Reasoning 

2.  Mechanical  Comprehension 

3.  Mathematics 
Relative  Movement 

5 . Spatla?  Relations 


Group  A 

Group  B 

N = 527 

N « 340 

Form 

2 

Form  3 

Form 

Form  2 

Form 

2 

Form  3 

Form 

5 

Form  2 

Form 

2 

Form  3 

Form 

* 

S 

Form  2 

Form 

2 

Form  3 

Form 

5 

Form  2 

Form 

2 

Form  3 

Form 

3 

Form  2 

Three  testing  periods  were  used:  OSOO-llOO  and  1500-1700  on  March  13 
and  0800-10^5  on  Jferch  14.  Use  of  these  spread-out  periods,  together 
with  "breaks 11  during  the  periods,  assured  that  fatigue  would  be  kept 
from  influencing  the  results  in  any  appreciable  way.  Counterbalancing 
the  order  of  presentation  for  the  two  approximate  halves  of  the  class 
made  possible  an  evaluation  of  the  practice  effect,  that  is,  the  gain 
in  score  on  a second  form  which  might  be  attributed  to  having  taken 
first  another*  form  of  the  test. 

In  Table  5 are  presented  the  descriptive  statistics  for  the  five 
pairs  of  test  forms  for  the  two  different  sequences  of  administration. 

It  is  evident  that  the  practice  effect  was  quite  small  in  the  cases  of 
the  Verbal  Reasoning  Test  and  Mechanical  Comprehension  Test.  For  the 
other  three  tests,  the  practice  effect  ranged  from  a little  less  than 
a fifth  to  somewhat  over  a half  of  a standard  deviation.  There  seemed 
to  be  a slight  tendency,  in  the  cases  of  these  latter  three  tests,  for 
the  transfer  from  Form  3 to  Form  2 to  be  a little  higher  than  that  from 
Form  2 to  Form  3*  It  may  be  that  this  demons trates  that  the  attention 
devoted  to  impi-oving  clarity  of  test  directions  thus  was  reflected  in 
rest  performances;  the  results  cited  are  consistent  with  such  a hypothe- 
sis > 


I 
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Table  5 

Raw-Score  Means  and  Standard  Deviations  of  0.  C.  B.  Tests 
for  Form  2 - Form  3 and  Form  3 - Form  2 Orders 
of  Administration  During  Standardization 

Order 


Form  2- 

•Form  3 

Form  3* 

•Form  2 

Test 

N - 

527 

N - 

540 

M 

S.D. 

M 

8.D. 

1.  Verbal  Reasoning 

Form  2 

47.1 

10.4 

48.0 

10.9 

Form  3 

47.7 

9.2 

47.6 

9.4 

2.  Mechanical  Comprehension 

Form  2 
Form  3 

26.6 

22.9 

7.1 

7.1 

26.6 

22.5 

7.1 

7.2 

3*  Mathematics 

Form  2 

24.7 

7.2 

26.4 

8.0 

Form  3 

25.3 

8.3 

23*3 

7.7 

4.  Relative  Movement 

Form  2 
Form  3 

22.9 

27.1 

5-5 

6.9 

26.2 

25.0 

6.2 

6.3 

5.  Spatial  Relations 

Form  2 
Form  3 

390 

36.1 

8.2 

9.9 

42.8 

34.4 

8.3 

9-9 

In  Table  6 are  given  correlations  between  the  two  forms  of  each 
of  the  five  0.  C.  B.  tests  for  each  order  of  administration.  The  ob- 
served inter-form  correlation  for  the  Relative  Movement  Test  was  the 
only  one  to  go  below  .80.  However,  this  finding  is  consistent  with  in- 
formation which  the  Classification  and  Survey  Research  Branch  has  ob- 
tained regarding  the  reliabilities  of  the  0.  C.  B.  tests.  For  both  an 
Annapolis  and  a General  Line  School  sample,  the  reliability  of  this 
test  was  estimated  as  being  approximately  .70,  using  a Kuder-Richardson 
formula.  The  inter-form  correlation,  of  course,  represents  an  alterna- 
tive method  of  assessing  test  reliability,  providing  the  test  forms  are 
considered  parallel.  In  the  present  instance,  then,  the  lower  inter- 
form  correlation  observed  in  the  case  of  the  Relative  Movement  Test 
enould  not  come  as  any  surprise.  In  fact,  that  the  observed  correla- 
tion is  as  high  as  it  is  gives  added  confidence  that  the  two  forms 
measirre  essentially  the  came  composite  of  mental  abilities. 


-13- 


Table  6 

Correlations  between  Scores 
on  Forms  2 and  3 of  0.  C.  B.  Tests 

Correlation 


Test 

Form  2-Form  3 
N = 527 

Form  3 -Form 
N <=  540 

1.  Verbal  Reasoning 

.81 

.82 

2.  Mechanical  Comprehension 

.80 

.80 

3-  Mathematics 

.86 

.86 

4 . Relative  Movement 

• 70 

.71 

5.  Spatial  Relations 

.85 

KA 

CO 

It  can.  in  addition  be  pointed  out  that,  as  a precaution,  another 
check  on  the  new  Relative  Movement  Test  had  already  been  carried  out, 
using  as  subjects  1107  members  of  Class  10  at  the  Officer  Candidate 
School.  The  correlations  observed  between  the  two  forms  were  .71  and 
.69  for  the  Form  2 - Form  3 and  Form  3 - Form  2 orders,  respectively. 

The  two  sets  of  results  were  thus  very  consistent. 

Conversion  Tables.  As  the  final  step  in  the  development  of  an  alternate 
form  of  0.  C.  B.  there  remained  the  construction  of  tables  for  the 
conversion  of  raw  scores  on  the  new  test  forms  to  the  Navy  Standard 
Score  scale.  There  already  existed,  of  course,  a conversion  table 
for  this  purpose  for  use  with  Form  2 scores;  it  was  desired  to  link 
Form  3 raw  scores  into  this  table.  The  problem  was  consequently  de- 
fined as  that  of  determining  what  raw  score  on  the  newer  Form  3 cor- 
responded to  a given  raw  score  on  Form  2.  For  this  linking  together 
of  scores  on  two  alternate  forms,  a linear  model  seemed  distinctly 
appropriate.  Thus,  the  problem  became  one  of  determining  proper 
values  for  the  constants  a and  b in  the  conversion  equation 


Y*  *=  aY  + b 


; 


(1) 


r 


t 
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in  which  Y represents  raw  score  on  Form  3 &nd  Y*  is  the  converted  score 
that  corresponds  to  a given  score  on  Form  2. 

It  was  noted  earlier  that  the  order  of  administration  was  counter- 
balanced, Form  2 being  given  to  half  the  group  first  and  Fomi  3 being 
given  to  an  equivalent  half  first,  and  that  this  testing  arrangement 
made  possible  an  estimate  of  the  practice  effect.  The  next  problem  was 
to  estimate  from  the  statistics  at  hand  the  means  and  standard  deviations 
for  tests  in  Forms  2 and  3 that  would  be  found  if  there  were  no  practice 
effect.  Hie  formulas  used  in  obtaining  the  values  are  given  below. 

In  these  formulas,  statistics  relating  to  the  group  taking  test  form  X 
first  are  denoted  by  a single  prime,  whereas  these  relating  to  the  group 
taking  test  form  Y first  are  denoted  by  a double  prime;  X represents  a 
raw  score  on  Form  2;  Y,  a raw  score  on  Form  3- 


X = i (X1  + X"  - 1^)  . (2) 

Y - i (Y'+  Y"  - Ky)  . (3) 


i 

H 

f i 

i 

Kx 

• 

00 

ji 

. j 

s1  =c 

Y 

• 

(5) 

. 1 

i 

C -if 

'X"  - X' 

, Y”  - Y’^ 

(6) 

1 

e - 2 1 

Sx 

'+  SY  J ■ 

ii 

HN 

II 

(S*,  + 

4„) 

(7) 

I 

s2  - A 

sy  “ 2 

(S?,  + 

s2,,) 

(3) 

In  the  above  set  of  equations,  equations  (2)  and  (3)  provide  the 
best  estimates  of'  the  mean  of  Form  2 and  Form  3;  respectively,  taking 
into  account  both  orders  of  administration.  and  Ky  represent  incre- 
ments due  to  practice  effect.  Equations  (4)  and  (5)  state  the  assump- 


r 
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tion  that  these  increments  are  proportional  to  the  standard  deviations 
of  the  tests,  and  equation  (6)  provides  a means  for  estimating  the 
constant  of  proportionality.  Ihe  assumption  that  the  practice  effect 
on  each  test  is  proportional  to  its  standard  deviation  seems  reasonable 
to  make  in  this  situation,  wherein  the  pairs  of  tests  are  alternate 
forms. 

By  appropriate  algebraic  manipulations  of  equations  (l)  through 
(8),  equation  (l)  can  be  restated  as 

Sy 

Y*  (Y  - -sY'  - £y”)  + i(X’  + X")  . (Q) 

i 

If  we  now  define 


and 

B « X - A?  , 
we  may  then  re-write  (9)  as 

Y*  - AY  + B 

1 In  Table  7 there  are  given  the  values  of  A and  B for  converting 

raw  scores  on  each  of  the  five  Form  tests  so  a3  to  make  them  compara- 
ble with  raw  scores  on  the  corresponding  Form  2 test.  By  use  of  the 
resulting  conversion  equations,  it  was  possible  to  develop  conversion 
tables  for  use  with  the  new  test  forms.  In  these  tables,  not  only  are 
raw  scores  on  the  two  forms  linked,  but  also  there  are  indicated  the 
Navy  Standard  Scores  corresponding  to  particular  raw  scores  on  either 
test  form.  In  making  these  tables,  the  relationship  between  Form  2 
test  scores  and  Navy  Standard  Scores  was  carried  over  from  tables  al- 
ready  in  existence,  so  that  whatever  meanings  had  been  built  up  in 
1 the  several  years  of  experience  in  the  use  of  Form  2 of  the  battery 

1 could  be  applied  also  to  Navy'  Standard.  Scores  derived  from  the  new 

form  of  the  battery.  These  conversion  tables  appear  in  the  Appendix 
as  Tables  A- 8 through  A-12. 


i 
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Table  7 

Coefficients  of  Conversion  Equations 


Form 

2 

Form 

3 

A 

B 

Test 

X 

°x 

Y 

°Y 

(W 

(X  - AY) 

Verbal  Reasoning 

47-5 

10.7 

47.7 

90 

1.1436 

-6.9809 

Mechanical  Comprehension 

26.6 

7.1 

22.7 

7.1 

0.9912 

4.0780 

Mathematics 

25.6 

7.6 

24.3 

8.0 

0.9508 

2.4809 

Relative  Movement 

24.6 

5.9 

26.0 

6.6 

0.8844 

1.5160 

Spatial  Relations 

4l.l 

8.3 

35-3 

9.9 

0.8353 

11.5833 

Additional  Form  of  the  Mechanical  Comprehension  Test 

During  the  course  of  development  of  Form  3 of  the  Officer  Classifi- 
cation Battery,  the  Navy  expressed  its  need  for  a further  form  of  the 
Mechanical  Comprehension  Test.  Hence  the  process  of  development  de- 
scribed above  was  repeated  on  a smaller  scale  to  produce  this  additional 
test. 

An  examination  of  Table  A-3  in  the  Appendix  will  reveal  that  follow- 
ing the  selection  of  items  for  Form  3 of  the  Mechanical  Comprehension 
Test  there  still  remained  some  unused  items  from  the  try-out  forms 
A0CX1  and  A0CX2  which  would  be  suitable  for  use  in  an  operational  test. 

To  secure  the  additional  itema  that  would  be  required  for  a 48- item 
final  form,  further  items  were  written.  Following  appropriate  review, 

60  of  these  items  were  then  included  in  a try-out  test  booklet,  called 
form  B0CX1. 

This  try-out  booklet  was  administered  to  part  of  Class  10  at  tie 
U.  S.  Naval  School,  Officer  Candidate,  on  January  20,  1953*  Item 
analysis,  based  on  370  of  these  cases,  was  carried  out  using  as  the 
criterion  the  score  on  Form  2 of  the  test.  Difficulty  indices  were 
then  brought  into  line  with  those  for  the  earlier  preteste  so  that  all 
available  items  might  legitimately  be  compared  in  difficulty. 
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Table  A-15  in  the  Appendix  gives  information  on  the  difficulty  and 
discrimination  indices  of  items  chosen  for  inclusion  in  the  Mechanical 
Comprehension  Test,  Form  2 Revised.  .As  had  been  true  with  tests  in 
Form  3,  this  test  was  reproduced  by  the  government  from  photo-offset 
copy  supplied  by  ETS  as  the  contractor. 

Standardization  of  this  new  test  was  carried  out  in  the  fall  of 
1953*  Members  of  Class  14  at  the  Officer  Candidate  School  served  as 
subjects.  Testing  was  accomplished  on  September  18.  About  half  of 
the  men  (507)  took  the  tests  in  the  regular  battery  (Form  2)  and  then 
the  new  Mechanical  Comprehension  Test;  the  other  half  of  the  men  (505 ) 
took  the  new  Mechanical  Comprehension  Test  in  place  of  the  Form  2 test, 
and  then  took  the  Form  2 test  after  the  completion  of  the  other  five 
tests.  Data  from  the  standardization  are  provided  in  Table  8.  Hie 
conversion  table  resulting  from  the  standardization  is  Table  A-l4  in 
the  Appendix. 


Table  8 

Statistical  Data  from  the  Standardization  of 
the  Mechanical  Comprehension  Test,  Form  2 Revised 


Form  2 

Form  2, 
Revised 

Raw  Score  Mean 

28.84 

29.68 

Standard  Deviation 

7.32 

7.82 

Coefficient  A 

1 . 0666 

Coefficient  B 

- 

■1.0819 

Intercorrelation 

.82 

tem- Analysis  Data:  Verbal  Reasoning 

Criterion:  Score  on  Test  1,  Form  2 


used  in  Form  3 
not  used  in  Form  3 


! 


u. 

31 

&■ 

k 

if 

i> 

W' 


i 

* 

V 


§ 


4 

■ft 


5 


*r 

♦- 


: 


j.  *xapuj  uoj^BTituniaosxQ 


fO, 


* O 


I 
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Item  used  in  Fote  3 
Item  not  used  in  Form 


Item-Analysis  Data:  Mechanical  Comprehension 

Criterion:  Score  on  Test  2,  Form  2 


r 


B 

ii 


i 

u 


II 

M M 


• O 


used  in  Form  5 
not  vised  in  Form  5 


Item- Analysis  Data'  Relative  Movement 


Item  used  in  Form  5 
Item  not  used  in  Form 


used  in  Form  5 
not  used  in  Form 


TABLE  A- 8 


Conversion  Table 

OCB  Forms  II  and  III  - Part  I - Verbal  Reasoning  Test 


Raw 

Score 8 

Standard 

Fonn  II 

Form  III 

Score 

74-75... 

-71-75 

74 

71-73-.. 

68-70 

73 

GROUP  1 

70. . . . 

68-69. 

• • • • • • • 07 •«•••• 
•••••• • 66 ••*••• 

• • 0 . . . . 72 

71 

High 

67.... 

ga 

• • • • • • • mo 

70 

Includes  highest 

66 ... . 

«••••••  64 

69 

7#  of  officers 

65 

6^ 

• • • • • 0 • J m • • • • • 

68 

63-64. 

»••••• .61-62. • • 

67 

62 

* . . .... 60 ...  ... 

.......66 

61 

•••••••——  • • • 0 • • 

65 

60 ... . 

...... • 59* . • • • . 

.......63 

59-... 

....... 5^ .... • • 

GROUP  2 

38 

*.».(-«»  57  ..•••* 

Above  Average 
Includes  next 

57.. .. 

56. .  . . 

55-... 

54 

cs6 

. 0 . . 0 . . v-  ...... 

.......  55  ****** 

... . • • . 5^'* ... .. 

....... 53 •••••• 

59 

.......58 

57 

2 4$  of  officers 

53 .... 

. 

56 

52 

....... 52 ...... 

55 

31 

....... 51 ....«• 

54 

49-50. 

....... ^9*50 • • • 

53 

GROUP  3 

48 

^ | 0 • • • 

.......4^...... 

. . . e . . . 51 

Average 

46 ... . 

0 .....  . 46 ...... 

50 

Includes  middle 

44-45. 

ka 

.......  “ ...... 

49 

38$  of  officers 

43 

.....  . . 4^4  ...... 

..48 

41-42. 

.......  42-43  < . . 

47 

40 

....... 4l ...... 

46 

39..-. 

.... ... ...... 

45 

37-38. 

. 0 . . . . *39* • • • • • 

.......44 

35-36. 

.37-38. . . 

43 

GROUP  4 

34 

32-33. 

.......  ;>6 ...... 

v. ..... . 34-35 . » 3 

Below  Average 

31 

......*33****** 

Includes  next  lowest 

28-30. 

...... .31-32. . . 

39 

24$  of  officers 

27 

....... 30 ...... 

38 

24-26. 

...... .27~ 29. « » 

-37 

21-23. 

25-26. . . 

.......36 

18-20 . 

.......  22-24 ... 

35 

GROUP  5 

16-17. 

••«•••• 34 

Low 

0-15. 

33 

Includes  lowest 

7$  of  officers 


table  a- 9 


I 


c 


Conversion  liable 

OCB  Forms  II  and  III  - Part  II  - Mechanical  Comprehens'.on  Test 


Raw  Scores 

Standard 

Form  II 

Form  III 

Score 

47-48 

. .43-48 

46 

» • 42* «•••••• 

81 

45......... 

• • •••••••• 

*73 

GROUP  1 

44 

43..... 

• • • • 0 • 40  • • • • • 

•••••• 39 • • • • • 

..77 

76 

High 

42..... 

• • • # « .38. • • • * 

74 

Includes  highest 

41 

• • • • • *3T • • • • • 

72 

of  officer* 

40 

• •••••  3^ 

70 

39 

• • • • • .35* • • • • 

68 

38 

•»•••• 34 • • 0 • • 

67 

37 

• ••••• 33  * • • • • 

65 

36 

••••0 .3^ 

GROUP  2 

35 

• ••••• 3X • • • 0 • 

34 

• ••*•• 30 • • • • • 

Above  Average 

33 • • • • • 

• ••••• 29 • 0 • • • 

59 

Includes  next 

32..... 

• ••«•• 23 • • • • • 

58 

24$  of  officers 

31 

r**-r 

30 

0 « • v • • 26 • • • • • 

56 

29.. . . . 

0 0 0 • 0 • 23  • • • • • 

28 

• •••••  24 

53 

GROUP  3 

27..... 

•»•••• 23 • • • • • 

Average 

Includes  middle 

26 

25 

24..... 

23 

• ••••• 22  0 • • • • 

• ••••• 2X • • • • • 

•*yN 

50 

49 

*7 

43 

38$  of  officers 

• • tOttl^*1***  0 

22 

• 18  ••••■* 

-43 

GROUP  4 

21. ... . 
20 

• • • • 0 tXy • • • 1 • 

• t : e • »X6 1 » » » r 

Below  Average 

19 

00000  0X3 • • • • • 

Includes  next  lowest 

18 

• • 0 • • • 3.4  • • • • • 

37 

24$  of  officers 

17 

• ® • • • 0X3* • • • • 

56 

16 

i 0 i : 0 0X2*  « 0 • • 

.........35 

13 

GROUP  5 

14 

-L3  » • 0 0 • 

0 0 0 0 0 0 XO  0 0 0 0 0 

32 

Low 

12..... 

.........31 

Includes  lowest 

XX  • ■J  0 0 0 

n 

7$  of  officers 

10 

6 

...» 29 

0-9. . . 

■ 0 # 0 » 0 0 0 *■  3 © • t 

TABLE  A- 10 


tr 

i 


1j&?A  - 

Conversion  Table 

OCB  Forms  II  and  III  - Part  III  - Mathematics  Test 


* 

Raw  Scores 

Standard 

Form  II 

Form  III 

Score 

50 . . 

• • • 50  •*••©•*• 

78 

w 

48-49 

4°J<o 

• • • ^ -r^y  • . • T i 

77 

47 

}l  "▼ 

• (•t|*(«0000( 

76 

46 ....... . 

• • • • • •••••« 

75 

w 

group  i 

45........ 

• • • ^3 »••••••■ 

o....74 

r 

High 

Includes  highest 
7$  of  officers 

44 

.73 

m 

1 

43 

42 

4l 

• • • 43 •••••••• 

lip 

* • * T £1  •••••0*0 

. . .4o-4l 

72 

71 

70 

* • 

40 

• • • • ••••••<> 

69 

45 

39 

0 • • 38 •••••••• 

67 

1 

p 

38 

• • • 37 •*••••*• 

1 

37 

a • a ••  (•»••• 

64 

• *>  • • • >-^T 

•••*•<>•• 

• 35  •••••••© 

63 

GROUP  2 

35 •••••©•• 

• • • 34 • ••••••• 

i 

Above  Average 
Includes  next 

34 

33 

32 

31 

0 0 • 33  •••••*•• 

• • • 32 • ••••*•• 
0 * • 31 •••••••• 

• 0 • 30  •••••©•• 

59 

57 

56 

fc  - 

«■ 

g 1 

24$  of  officers 

30 

• • • 29 •••••••• 

• • 9 • • 5^ 

g 

GROUP  3 

29 

2&* •••»»•• 

• • © 2d ••••••©• 

• • ©2  ( 

51 

1' 

Average 

27  •••••*»»• 

0 0 • 26 •••••••• 

50 

$ 

Inc  lilies  middle 

26 

• • • 23  •••••••• 

49 

38$  of  officers 

25 

■ n ■ ? 4 «•»#•••  « 

,..,47 

24 

* • • 23  •••••©•• 

46 

23..= 

• • a £l2 

.....45 

2^o ... 

• OB  21  • B • B • • • O 

...,.44 

21 

• 0 0 19-20. • • 0 0 

GROUP  4 

20 

19... 

O O .18.  B B B B O B B 

» B ol7  BI(BB*BB 

41 

- 

Belov  Average 

. 18... 

• • b l6 ••••••BB 

• ■*•••  40 

Includes  next  lowest 

17 

• • • 15  • • • • • • • © 

38 

24$  of  officers 

16 

O • B 14 ••••BBBB 

37 

15 

1 X 

«BB_  /*a*BBB  » • 

at 

l4 .. 

B • b12b  •••••• 

35 

£r. 

£ 

r i 

GROUP  5 

13 

OB*  11  •••••••© 

3^ 

Low 

12  • •••BOOB 

» » • 10  >«*B|»*t 

.....33 

**.■  ■ 

Includes  lowest 

11 

BB  *©9*  ••••  a B O 

• . • . 32 

7$  of  officers 

0-10 • ••<>• 

l 

- 


T4BLE  A-ll 


Conversion  Table 

OCB  Forms  II  and  III  - Part  IV  - Relative  Movement  Test 


GROUP  1 
High 

Includes  highest 
7$  of  officers 


GROUP  2 

Above  Average 
Includes  next 
24$  of  officers 


GROUP  5 


Average 

Includes  middle 
38$  of  officers 


GROUP  4 

Below  Average 
Includes  next  lowest 
24$  of  officers 


GROUP  3 
Low 

Includes  lowest 
7$  of  officers 


Form 

Raw 

II 

Scores 

Form  III 

Standard 

Score 

50. 

• • * 

• • • • ft*"1"  ••»•••• 

49. 

• • • 

• ••••****•••••  •• 

86 

48. 

• • • 

84 

47. 

• • • 

• ft  • e • • • • • » • 

46. 

• • • 

• • • • • 50  • • • • • • • 

81 

45- 

• 0 • 

4q 

• • • • • • • • • • • 0 

44. 

• • » 

• • • • « 48  • • • • • • • 

78 

45. 

• • • 

• • • • • • • » • • • • 

..76 

42. 

• • • 

• • • » • 46 • • • • • • • 

74 

4i. 

• • • 

• • • • » 45 • • * • • • • 

72 

4o. 

• • • 

71 

39- 

• • • 

» • • • • ^2 • • • • • • • 

38. 

• • • 

• • b • • 4 1_  ••••••• 

63 

37. 

• • • 

« • • • • 40 « « • • • • • 

66 

36. 

• « • 

• • • • • 59 ••••••• 

33. 

• • • 

• • • • *3®* • • • • • • 

64 

34. 

• • • 

• • • • • 5*7 ••••••• 

62 

33- 

• » • 

• • ...56. •••••• 

32. 

• • • 

59 

31. 

• • • 

• • ♦ • • 55 •*••••• 

53 

30. 

• • • 

• • • • a 52 • • • 0 • • • 

56 

29. 

• • • • • 51  ••••••• 

54 

?8. 

• 0 • 

• • • • • 50 • • • • • • • 

27. 

« • • 

• • • • • 29 • • • • * • • 

52 

26. 

• • • 

• • • • • 28 • • • • • • • 

50 

25. 

• • • 

26-27 

.48 

24. 

• • • 

47 

23. 

• • • 

Ok 

• • • • • • • • 0 • • • 

46 

22. 

• • • 

ft  ft  ft  ft  ft  25  •••*■••> 

.......44 

21. 

• • • 

• • •* • • 22 • • • • • • • 

20. 

• • • 

• • • • • 21  • • • • • • 

19. 

• • • 

• • • • • 20  • • • • • • • 

18. 

• • • 

• • • • « 1*9  • •*•••• 

.......38 

17. 

36 

16. 

• • • 

• •>  • • • l6  • • # • • • 

35 

15. 

• • • 

• • • • • 15 ••••••• 

-34 

14. 

• • « 

• • • • • 14 • • • • • • • 

32 

13. 

• • • 

• 0 • • • 15 • • • • • • • 

• • • » • e • 50 

0- 

12.. 

.......29 

TABLE  A-12 


i 

j 


Sal 

, 


Conversion  Table 


OCB  Forms  II  and  III  - Part  V - Spatial  Relatione  Test 


GROUP  1 
High 

Includes  highest 
7$  of  officers 


GROUP  2 

Above  Average 
Includes  next 
24$  of  officers 


GROUP  3 


Average 

Includes  middle 
58$  of  officers 


Raw 

Scores 

Standard 

Form  II 

Form  III 

Score 

60 

77 

59 

f 7 

• rt**^(**«*i3 

76 

58 

55-56... 

75 

57 

• • • • • • • • • 

74 

56 

• • • • • 33 •••••• 

75 

55  • • • « « 

» • » • • yC*  • • * - • 

71 

54 

• • • p • 51  • • • 0 0 « 

70 

55 

• • • • . 9 0 

52 

• • • • • 4 9 » *•••• 

.......68 

51 • • 0 • • 

kV 

• • • ••‘■t  •••••• 

• • • • • 46  •»»•<>• 

67 

50 

65 

49 

• • • *>  • • • • • 

64 

48 

43-44.. . 

• • 0 • • • .63 

47..... 

• • • • *42». « 6 ••  • 

46 

• • • • • ^4-1  •••••• 

45..... 

0 • • • • ^40  •»•••• 

59 

44 

••©••39* •• ••• 

43 

• • • • • 3® •••••• 

- 57 

42... 0. 

4l 

0 • • • • 35 •••••• 

40 

• • • • • 34 •••••• 

59 

33 

58..... 

TO 

• • • • C •»•••(> 

57..... 

50 

36 * c 0 • • 

• • • 0 • ^9  ****** 

4q 

• 0 » • t 0 *“7 

55..... 

28 

» • v • • CU  • • • 0 • • 

47 

54 

• • • • * •••«•• 

.46 

■z* 

y ^ 0 0 • • • 

• • • • • 26 •••••• 

.......45 

32... 

44 

GROUP  4 

31.. . 

30. . . 

9999909 23 ••••••••• 

43 

Below  Average 

29. .. 

9 9 0 9 9 9 9 21  ••••••••• 

Includes  next  lowest 

28.  . . 

99099 39 

24$  of  officers 

27.  . . 

33 

26. .. 

56 

25... 

.....35 

m 

unuur 


24 

e • *15  * * * • • • 

9990999 34 

23 

• • • X4 •••••• 

....... 33 

22 

...12-13... 

32 

21 

• « • 3-1  •••••• 

30 

20. 

• 0 • 10  999999 

29 

3-9  ****00*t 

9 9 0 9 9 • • • • • • 

28 

i8 

• • * uOl  • •••• 

27 

17. 

6-v 

O O 9 * Vil”  j O 9 » • 

....... 26 

16. 

• • • • 3 • ° ♦ * * 

...... .24 

0-18 

0-4. . . . 

.......  23 

Low 

Includes  lowest 
7$  of  officers 


TABLE  A-13 

Item- Analysis  Data;  Mechanical  Comprehension  Form  2 Revised 
Criterion:  Score  on  Test  2,  Form  2 

(Data  from  A0CX1,  A0CX2,  BCCXl) 


j *xspup  uop^Buprpjospa 


TABLE  A-l4 


» 


* 


Conversion  Table 

OCB  Foims  II,  III  and  Form  II  Revised  - Part  II  - 
Mechanical  Comprehension  Test 


Raw  Scores 

Form  II 

Standard 

Form  II 

Form  III 

Revised 

Score 

47-48.. 

. . . .43-48. . . . 

82 

46..... 

» • • • ••••••  1 1 

• • • • • • • • • 

.....81 

CROUP  1 

45.. .. 

44.. .. 

• 0 *»  • •••••<>• 

• • • • Ho ••••»•• 

• • • • •*••••»•• 
• • • • ^6 (••••••* 

..78 

..77 

High 

43 

• • • *59 * 0 0 » <">  • • 

• • • • H3 •••••••• 

..76 

Includes  highest 

42 

• • • • 3B • • 0 • • • • 

44 

• * • * t r ••••••«• 

..74 

7#  of  officers 

41 

* • • • 3T ••«•••• 

• • 0 ♦ H J ((•••••■ 

-.72 

40 

• • • • 36 0 • 0 • • • • 

• • • • H2 • • • 0 0 • •• 

..70 

59--. 

. . . .35 

. . . , 40-41 

..68 

38.... 

• • • • 3^  0 * • • * 0 • 

• 35  •••••••• 

..67 

37* » » • 

XX 

• • • • j j • * © • • « • 

• • • • 38 •••«•••• 

..65 

GROUP  2 

Above  Average 
Includes  next 
24$  of  officers 


GROUP  3 
Average 

Includes  middle 
38#  of  officers 


GROUP  4 

Below  Average 
Includes  next  lowest 
24#  of  officers 


GROUP  3 
Low 

Includes  lowest 
7#  of  officers 


36.. 

. ,32 

0 9 * 9 9 9 37  •••••«»••» 

35 

. .31- 

•90099 36 9999099999 

34. 

Xfi 

«*  • "jXJ  • • • • • 

0 0 9 9 0 9 35  • 

33 

• • 29 • • • • 4 

• •••••  3^  9909999099 

32 

• .28. . • • . 

999999 33 ••••••«••• 

31....... 

• c 27 • • • • • 

• • • • « .32.  • ?••••••• 

30 

• • 26 • • • • « 

29 

• <•  23  • O • • • 

28 

. .24. . . , . 

27....... 

• • 23  • • • 0 * 

26. 

. • 22. . . • • 

25 

. . 21 . . . . . 

24 

. 0 20 ..... 

25,....=. 

• • 19  •••%.• 

22 

• ( 18  •••*-• 

21. 

. .17 

9 9 * 9 9 9 21  ■«•»•••£••* 

20 

• • l6 

19 

. .15 

9 9 9 0 r ' 1-9  * 

18 

• al1^  « • • • • 

17 

*1  X 

« *4.  / • • 0 9 • 

16 

9 ( X2 9 0 9 9 9 

15 

O 9 LI  <-»••• 

l4 

• • 10  9 0 9 9 9 

13 

909^09900 

1 X 

A 9 9 9 * • ,1-  J 9 9 9 9 0 9 9 9 9 9 

*i  ? r * 

...8 

P 

11..... 

f 7 

Ti 

10 

0-9 0-5 0-9 


64 

62 

60 

59 

58 

57 

56 

55 

53 

51 

50 

49 

47 

45 


45 

•'ll 

40 

38 

37 

36 

35 

34 

33 

32 

31 

30 

29 

28 


